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SECTION  I,  INTRODUCTION 

The  Expert  Panel  Review  Report  Is  an  Interim  document.  It  presents 
the  results  of  one  major  task  in  AUERBACH* s long  range  planning  study  for  the 
Defense  Documentation  Center  under  Contract  No,  DSA900-75-C-5161 . The  con- 
clusions and  recommendations  discussed  in  this  volume  are  directed  toward 
predicting  the  likely  course  of  advancement  6f  information  processing 
technology, 

1.1  PURPOSE  AND  USE  OF  THE  TECHNICAL  NOTE 

This  document  is  intended  to  be  used  primarily  by  DDC  and  the  project 
team  to  formulate  a set  of  reasonable  time-phased  assumptions  about  future  infor- 
mation technology,  information  organizations,  and  economic  factors.  As  a pro- 
ject document,  the  Expert  Panel  Review  Report  serves  as  an  outline  of  future 
developments,  which  will  influence  the  final  recommendations  of  the  comprehensive 
study  now  underway  for  the  target  period  1978-1988.  For  this  review,  the 
results  of  a literature  survey,  an  interagency  survey  and  an  internal  review 
of  DDC  plans  and  operations  have  been  converted  to  a select  list  of  future 
events  that  are  expected  to  be  especially  relevant  to  the  DoD  RDT&E  informa- 
tion processing  and  using  community.  However,  some  of  the  conclusions  have  a 
generality  about  them  that  could  have  implications  beyond  DoD.  Thus,  agencies 
other  than  DoD  agencies  may  find  these  rubults  of  interest. 
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1.2 


EXPERT  PANEL  REVIEW  SUMMARY 


Highlights  of  the  Expert  Panel  Review  and  AUERBACH *s  conclusions 
and  Interpretation  are; 

• Important  Trends 

- Scientific  bibliographic  Information  systems  are  following 
a trend  that  will  eventually  result  In  a comprehensive. 
International,  cross  disciplinary  and  Integrated  data  resource 
that  will  be  accessible  to  Individuals  through  single  access 
points 

* The  highest  payoff  area  for  Increased  scientific  and  technical 
information  service  Is  factual  data  services  that  are  non- 
bibliographic 

- Information  analysis  services  will  be  an  Increasingly 
Important  component  of  total  technical  Information  systems 

- The  application  of  electronic  devices  to  the  control  and 
manipulation  of  Information  data  is  a dominant  trend.  The 
particular  devices  themselves  are  basically  of  incidental 
importance.  It  is  the  applications  techniques  for  informa- 
tion handling  that  facilitate  total  electronic  control  of 
technical  information  processes  that  are  among  the  most 
important  matters  to  be  resolved. 


• Technology 

- Large  computers  designed  specifically  for  textural  informa- 
tion processing  are  unlikely.  Peripheral  and  decentrallser 
special  purpose  units  are  desirable  and  feasible 

Complete  electronic  control  over  information  processing  opera- 
tions is  desirable.  A number  of  approaches  are  feasible 
depending  on  various  system  requirements 

- Electronic  storage  and  dissemination  media  will  virtually 
supplant  microform  media 

e Organizational  Structures  and  Affiliations 

- Interorganieational  cooperation  and  standardization  is  funda- 
mental to  the  advancement  of  information  processing  technology 
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• Economics 

•>  Cost  alone  is  not  a barrier  to  the  advancement  of  Information 
processing  technology 

e Services 

> New  concepts  in  service  are  seen  as  highly  desirable 

and  feasible  but  a perplexing  pessimism  is  expressed  con- 
cerning the  ability  of  the  information  community  to  develop 
them 

- Widespread  accessibility  to  many  data  bases  is  a highly 
desirable  objective 

Fact  services  are  a conspicuous  gap  in  current  Information 
services 

# Time-Phased  Goals 

- Quantum  advancement  of  information  processing  technology  is 
not  seen  before  1985.  Interim  progress  may  be  characterized 
by  standardization  and  expanded  bibliographic  Information 
services  involving  multiple  data  base  access  and  Interactive 
search  capability 

1.3  METHODOLOGY 


The  method  used  by  AUERBACH  to  conduct  the  Expert  Panel  Review  is  a 

modified  composite  oi  two  Delphl-llke  approaches!  (a)  the  SEER  (System  for 

Event  Evaluation  and  Review)  approach  developed  and  employed  for  technology 

assessment  by  Bernsteltii  et  al^  of  the  Naval  Supply  Systems  Command,  and  (b) 

2 

the  Probe  II  methodology  of  the  TRW  Corporation  employed  by  North  and  Pyke. 
AUERBACH'S  composite  methodology  consists  basically  of  four  steps: 

(a)  Development  of  a compendium  of  factual  data  and  potential 
events,  and  distillation  of  this  data  into  an  original 
Events  List.  (Discussed  in  Section  1.3.1  below). 


Bernstein,  G.  B.  et  al.  A Fifteen-Year  Forecast  of  Information  Processing 
Technology.  Washington,  D.C.,  Naval  Supply  Systems  Command,  1969.  (AD  681752). 

North,  H.  Q.  and  Pyke,  D.  L.  "Probes  of  the  Technological  Future."  Harvard 
Business  Review.  47(3):68-82,  May-June  1969. 
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(b)  (Round  I)  Evaluation  of  this  original  Events  List  by  experts 
Involved  in  information  transfer  at  the  R&D,  operations  and 
product  planning  levels.  (Discussed  in  Section  1.3.2  below). 

(c)  (Round  II)  Modification  of  the  Events  List  baaed  on  the  results 
of  Round  I,  and  re-evaluation  of  this  new  Events  List  by  a second 
round  panel  of  specialists  In  information  technology  and  indivi- 
duals in  influential  information  science  positions  who  are  con- 
cerned with  long  range  planning  and  administration  (Discussed 

in  Section  1.3.3  below) 

(d)  Analysis  of  results,  definition  of  the  state-of-the-art  and 
definition  of  potential  alternative  short,  mid-  and  long-range 
goals  and  identification  of  events  necessary  or  desirable  to 
support  these  goals. 


1.3.1  Development  of  the  Events  List 


A Literature  Survey  generated  a liet  of  about  70  ’’raw"  events  cover- 
ing technological  trends  and  future  predictions  for  the  information  coimunity. 
These  "raw"  generalized  events  were  then  distilled  into  41  events,  which  were 
seen  as  the  most  relevant  and  specific  to  DDC's  plans  and  interests.  This  was 
done  through  the  following  steps: 

e Close  inspection  of  all  available  DDC  descriptive  and  planning 
documents  to  Isolate  areas  of  high  interest  for  DDC 

e Review  of  the  documentation  of  the  Interagency  Survey  (a 
related  task  under  the  present  contract),  to  point  out 
developments  In  allied  organizations  which  would  be  most 
likely  to  Impact  on  DDC. 

e Formulation  of  a series  of  questions  In  connection  with  the 
areas  of  interest  (uncovered  as  described  above)  representing 
planning  options  for  DDC  (Shown  in  Appendix  D) 

a Translation  of  the  questions  into  a list  of  carefully  worded 
events,  designed  to  elicit  maxium  feedback  relevant  to  the 

DDC  plans. 


1.3.2  Round  I 


Round  I procedures  were  as  follows: 

(a)  Selection  of  Round  I Partlcipnnts 

The  Round  I participants  were  selected  to  provide  expertise  at 
the  operation  or  system  design  level,  such  as  practitioners  and 
researchers  in  various  phases  or  aspects  of  information  science 
(e.g.,  program  managers  of  significant  information  systems  and 
academic  researchers) . Effort  was  made  to  achieve  a broad 
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coverage  of  many  organizations.  Of  the  10  Round  I participants, 
five  represented  government  agencies,  three  represented  private 
"for  profit"  companies,  and  two  represented  ac  iemic  institutions. 

(b)  Solicitation  of  Responses 

The  Round  I Events  List  was  mailed  to  all  participants.  Approxi- 
mately five  days  later,  an  AUERBACH  representative  visited  each 
participant  to  physically  collect  the  List  and  to  answer  any 
questions  the  participant  might  have.  The  visit  also  acted  as 
a deadline  so  that  the  participant  could  not  put  off  responding 
to  the  Events  List. 

(c)  Analysis  of  Round  I Responses 

The  collected  Round  1 Events  Lists  were  cut  apart  so  that  each 
question  was  on  a separate  piece  of  paper.  Then  all  the  "event 
number  I's"  were  clipped  together,  etc.  The  number  of  responses 
for  each  category  and  subcategory  was  tallied,  and  the  percen- 
tages calculated.  If,  for  example,  9 participants  responded  to 
the  USER  DESIRABILITY  section  of  a particular  event,  and  of 
these,  3 checked  "desirable"  then  the  percentage  of  "desirable" 
responses  for  that  event  was  33%.  Years  given  in  the  PROBABLE 
TIMING  section  were  averaged  for  each  of  the  three  probabilities 
of  each  event.  The  comnents  for  each  event  were  read  care- 
fully and  analyzed  to  uncover  event  ambiguity,  redundancy,  and  low 
probability  of  occurrences.  Results  and  comments  were  used  as 
a guide  to  the  modification  of  the  events  for  Round  II.  (See 
Section  1.3.3  below). 


1.3.3  Round  II 


Round  II  was  the  second  iteration  of  the  two  part  Expert  Panel  Review. 
The  refined  events  list  of  Round  I was  reviewed  as  follows: 


(a)  Modification  of  the  Round  I Events  List 

Based  on  the  responses  of  the  Round  1 participants,  three  types 
of  modifications  were  made  in  the  events:  reduction  of  "abstracts" 

(changing  "all"  to  "most,"  for  example);  narrowing  of  scope 
(rewriting  one  event  as  two);  and  the  elimination  of  six  events 
which  were  seen  by  a majority  of  Round  I participants  as  both 
undesirable  and  unfeasible. 

(b)  Division  Into  Two  Events  Lists 


Round  II  was  to  be  conducted  with  two  separate  sets  of  partici- 
pants: a panel  of  experts  in  information  technology,  and  a 

panel  of  individuals  in  Influential  information  science  positions. 
This  division  of  Round  II  was  designed  to  achieve  a high  level 
of  precision  in  the  Round  II  responses.  Each  panel  represented 
a specific  segment  of  expertise  and  the  events  were  divided  to 
eliminate  extraneous  opinions  from  panelists  in  areas  outside 
their  area  of  expertise.  Accordingly,  the  revised  events  were 
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converted  to  two  lists:  Round  lA,  events  concerning  Information 

technologies,  and  Round  IIB,  events  concerning  information 
Issues.  Since  a Large  number  of  events  had  implications  for 
both  technology  and  Issues,  they  were  included  on  both  lists. 

The  Round  IIA  and  IIB  Events  Lists  with  the  aggregate  data 
are  Included  as  Appendices  B and  C,  respectively. 

(c)  Selection  of  Round  II  Participants 

The  Round  II  participants  were  chosen  to  represent  two  areas  of 
expertise  - technology  (panel  A)  and  planning  and  administration 
(panel  B) . Round  II  structure  was  weighted  to  favor  the  input 
from  the  planners  and  administrators  by  selecting  17  members  for 
panel  B versus  10  for  panel  A (In  the  analysis  the  aggregate 
data  were  averaged,  thus  the  17  panel  B responses  tended  to  have 
greater  influence  on  the  mean) . 

It  was  expected  that  the  points  of  view  expressed  by  the  two 
homogeneous  panels  would  be  divergent  when  examined  separately. 
This  assumption  proved  to  be  valid.  The  results  were  blended 
to  moderate  any  extreme  opinions  (especially  negative  opinions) 
since  the  experience  with  forecasting  studies  of  this  type  show 
that  technological  progress  is  often  realized  sooner  than  the 
experts  predict.  Thus,  we  hope  these  results  will  accurately 
represent  the  future  path  of  information  technology  advancement. 
This  part  of  the  methods’ ogy  was  applied  only  to  those  events 
which  had  implications  in  vechnology  as  well  as  in  organizational, 
economic  and  service  aspects  of  information  science. 

Events  that  were  purely  related  to  technology  or  purely  related 
to  planning  and  administration  Issues  were  submitted  only  to 
the  respective  experts  in  these  areas.  This  was  done  to  avoid 
collecting  spurious  data  provided  by  panelists  beyond  their  area 
of  expertise.  (Appendices  A,  B,  and  C indicate  the  events 
submitted  to  each  panel.) 

The  ten  Round  IIA  participants  (technology  experts)  were  selected 
from  the  staff  of  the  AUERBACH  Corporation  (excluding  the  DDC 
study  project  team).  All  are  senior  personnel  with  special 
expertise  in  the  fields  of  computers,  micrographics,  teleprocess- 
ing, or  information  systems  design.  Panel  IIB  consisted  of  17 
individuals  in  influential  information  science  positions  who  are 
concerned  with  long  range  planning  and  administration.  They 
represent  a cross  section  of  the  information  coomunlty.  Three 
were  affiliated  with  government  agencies,  seven  with  for-profit 
organizations,  and  seven  with  not-for-profit  institutions. 


(d)  Solicitation  of  Responses  from  the  Round  IIA  Participants 

The  Round  IIA  Events  Lists  were  distributed  In  person  by 
a member  of  the  project  team  to  panelists  who  previously 
had  been  asked  to  participate.  The  purpose,  scope  and 
procedures  of  the  task  were  reviewed  at  the  outset  and  each 
panelist  was  permitted  one  week  to  respond.  (The  list 
required  about  1^  hours  to  complete).  The  events  were 
collected  at  the  end  of  the  week  and  panelists  were  debriefed 
on  their  experience  with  Round  IIA  review  Instrument. 

(e)  Solicitation  of  Responses  from  the  Round  IIB  Participants 

The  Round  IIB  panelists  (who  had  been  Invited  to  participate 
by  telephone  with  follow-up  letters  of  Invitation)  received 
their  copies  of  the  Events  Lists  at  an  Initial  group  meeting. 

At  that  meeting,  the  project  was  reviewed  and  the  purpose 
scope  and  procedures  for  the  review  were  outlined.  There  was 
no  group  discussion  of  the  events.  The  review  was  estimated 
to  be  approximately  a 1^  hour  effort.  Jompleted  events  lists 
were  to  be  returned  by  mall.  All  results  were  received 
within  two  weeks. 

(f)  Analysift  f Round  II  Responses 

Each  panelist's  responses  were  first  examined  to  see  if  there 
were  inter-event  Inferences  reflected  in  the  responses  - espec- 
ially the  comment  responses.  If  so,  they  were  noted  on  each 
Involved  event.  Then  the  events  were  physically  separated 
and  recombined  so  that  all  responses  to  a given  event  were 
merged.  The  aggregate  data  were  collected  and  the  totals  were 
used  to  calculate  the  values  for  each  event.  Importance  was 
measured  as  the  percentage  of  panelists  who  indicated  an  event 
as  "important."  "Desirability"  and  feasibility  ratings  (assigned 
on  a scale  of  1 to  10)  were  averaged  for  each  event.  The 
"probable  timing"  dates  (i.e.,  forecasted  dates)  were  averaged, 
as  well.  The  data  were  analyzed  within  specific  areas  of  interest, 
generally  categorized  under  four  main  areas'  - technology, 
organizational  structures,  economics  and  marketing  and  services, 
niey  were  also  analyzed  for  trends  reflected  in  the  comments  and 
by  implication  of  the  relative  scores  of  interrelated  events. 
Appendix  A consists  of  several  tables  compiled  to  aid  the  analysis 
with  cross  comparisons  between  and  among  the  events.  Appendices 
B and  C report  the  aggregate  data  from  Round  IIA  and  Round  IIB 
respectively. 

1.4  RELATIONSHIP  OF  THE  EXPERT  PANEL  REVIEW  TO  THE  STUDY  AS  A WHOLE 


The  Expert  Panel  Review  is  but  one  of  four  major  facets  of  AUERBACH' s 
long  range  planning  study  for  DDC.  The  other  three  consist  of:  a User  Survey, 


an  Interagency  Survey,  and  an  Internal  Review  of  DDC  Plana  and  Operatlona.  The 
findings  of  all  four  facets  of  the  study  will  be  assessed  and  evaluated  separate- 
ly and  together  as  a final  report  intended  to  be  a DDC  planning  document 
appropriate  for  the  user  needs,  technological  capability  and  interorganization 
information  structure  forecast  for  the  decade  1978  to  1988. 

1,5  ORGANIZATION  OF  THE  REPORT 


The  remainder  of  this  report  is  divided  into  the  following  sections: 


• "lection  II: 

• Section  III: 

• Appendix  A: 

• Appendix  B: 

• Appendix  C: 

• Appendix  D: 

• Appendix  E: 


Discussion  of  Findings 
Conclusions  and  Interpretations 
Data  Tabulation 

Round  IIA  Aggregate  Data  with  Cooments 
Round  IIB  Aggregate  Data  with  Comments 
Questions  and  Issues  Related  to  the  Events 
Events  Classified  by  Desirability/Feasibility 


SECTION  II.  DISCUSSION  OF  FINDINGS 


This  section  discusses  the  data  of  the  Expert  Panel  Review  task.  It 
consists  of: 


• A summary  of  the  Round  II  results,  which  Is  the  second 
Iteration  of  the  two  part  Expert  Panel  Review  task. 

• A comparison  of  the  results  from  panel  IIA  (Technology 
experts)  and  panel  IIB  (Information  system  planners  and 
administrators) 

• A comparison  of  Round  II  results  with  the  Round  I panel 
(Information  system  practitioners  and  researchers) 


For  the  purposes  of  this  report,  the  following  definitions  apply: 


A.  Panel  Composition 

1.  Round  I Panel;  10  Individuals  with  expertise  at  the  sys- 
tems level,  such  as  practitioners  and  researchers  with 
expertise  In  various  phases  or  aspects  of  Information 
science  (e.g.,  program  managers  of  significant  information 
systems) . 

2.  Round  II 

a.  Panel  A;  10  technology  experts  In  the  fields  of 

computers,  micrographics,  teleprocessing  and  Informa- 
tion systems  design. 
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b.  Panel  B;  17  individuals  in  influential  information 
science  positions  who  are  concerned  with  long  range 
planning  and  administration. 

B.  Events  List  Data  Elements 


1.  Events ; significant  future  occurrences  relevant  to  the 

Information  community 

2.  Importance;  whether  or  not  the  panel  regarded  an  event 
as  potentially  a major  occurrence  In  the  Information 
science  field 

3.  Desirability;  a relative  assessment  of  the  need  for  a given 
event  within  the  information  community 

A.  Feasibility;  a relative  assessment  of  the  practicality  of 
a given  event  occurlng 

5.  Probability;  a relative  assessment  of  when  an  event  is 
likely  to  occur 

2.1  ROUND  II  FINDINGS 


The  Round  II  findings  represent  the  second  iteration  of  the  two-part 
Expert  Panel  Review.  The  data  are  compiled  In  detailed  tables  in  Appendices  A, 
B,  and  C.  The  main  features  of  the  findings  are  presented  In  this  section. 

Section  III  discusses  the  time  phased  implications  of  the  findings, 
which  take  into  account  the  combined  factors  of  importance,  desirability, 
feasibility,  and  probable  timing. 

Round  II  data  were  collected  for  thirty-eight  events  repreaantlng 
four  areas; 

e Technology 

e Organizational  Structures 

• Economics  and  Marketing 

e Services 

Each  event  was  considered  for  importance,  desirability,  feasibility, 
and  probable  timing.  The  data  for  each  event  were  averaged  to  give  a composite 
rating  that  was  used  for  the  overall  analysis  in  comparing  events  against  each 
other. 
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2.1.1 


Importance 


Participants  were  asked  to  designate  events  that  they  believed  to 
be  "major  events."  This  was  done  to  Impart  an  order  of  significance  to  the 
various  events.  Results  were  tabulated  as  straight  percentages  of  respondents 
who  designated  an  event  as  "major."  Events  accorded  the  highest  ratings 
(top  207.)  were  (In  order  of  scores,  high  to  low): 


• Interactive  access  to  full  text  data  bases  replacing 
abstracts  and  Indexes  as  searching  tools 

• Researchers  have  access  to  data  bases  of  factual  verified 
data 

• Acceptable  machine  generated  Indexes 

• Paper  will  be  replaced  as  the  primary  niunerlc  storage 

k medium  by  digital  media 

• Paper  replaced  as  numeric  dissemination  medium  by  digital 
media 

• Accessibility  of  many  data  bases  through  a single  terminal 

• Standardized  citation  formats 

• Interactive  access  to  citation  data  bases  replacing  abstracts 
and  Indexes  as  searching  tools 

• Information  synthesis  and  analysis  available  to  all  researchers 

• Optical  character  recognition  (OCR)  able  to  convert  any  docu- 
ment to  machine  readable  form 

• Machine  readable  storage  media  competitive  with  paper 


Events  accorded  the  lowest  ratings  (lowest  207.)  were  (in  order 
of  scores,  high  to  low): 

e Two  tiers  of  information  providers  will  emerge  and  be  clearly 
definable:  "wholesalers"  and  "retailers" 

e Minicomputers  coupled  with  perpherals  will  generally  take  over  many 
functions  currently  performed  by  large  centralized  computers 

e Major  IS&R  systems  will  permit  a choice  of  output  format 
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• Input  cf  information  to  large  IS&K  systems  (e.g.,  DDC,  NTIS, 
NASA,  etc.)  will  be  decentralized,  with  standardized  abstract- 
ing, Indexing  and  data  conversion  provided  at  the  local  source 
level 

• Federal  technical  information  services  becoming  self-support- 
ing 

s Dissemination  of  full  text  of  documents  precluding  the  need  for 
abstracts  as  announcement  devices 

• Automatic  monitoring  built  Into  retrieval  systems 

• Paper  replaced  as  document  dissemination  medium  by  microform 

• Computers  designed  specifically  for  bibliographic  storage 
and  retrieval 


These  results  indicate  a select  set  of  "Important"  trends  and/or 
technological  events: 


m Scientific  bibliographic  information  systems  are  following 

a trend  that  will  eventually  Coome  undetermined  date  beyond  1988) 
result  in  a comprehensive,  international,  cross  disciplinary 
and  integrated  data  resource  that  will  be  accessible  to  individuals 
through  single  access  points 

• The  highest  payoff  area  for  increased  scientific  and  technical 
information  service  is  factual  data  services  that  are  non - 
bibliographic 

• Information  analysis  services  will  be  an  increasingly  important 
component  of  total  technical  Information  systems 

9 The  application  of  electronic  devices  to  the  control  and  manipulation 
of  Information  and  data  is  a dominant  trend.  The  particular  de- 
vices themselves  are  basically  of  Incidental  Importance.  It  Is 
the  applications  techniques  for  Information  handling  that  facilitate 
total  electronic  control  of  technical  Information  processes  that 
are  among  the  most  Important  matters  to  be  resolved. 


2.1.2  Desirability  and  Feasibility 

Respondents  were  asked  to  rate  the  desirability  and  feasibility  for 
each  event  on  a scale  of  1 to  10.  The  aggregrate  scores  of  panel  A and  panel  B 
were  averaged  for  each  event.  Desirability  and  feasibility  averages  were  used 
to  group  events  by  class  ("most"  > 7.5,  "moderate"  5-7.5,  "least"  < 5). 
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The  results  have  been  tabulated  In  Appendix  E which  lists  eight  groups  from 
the  "Most  Desirable,  Most  Feasible"  events  to  the  "Least  Desirable,  Least 
Feasible"  events.  Each  group  Is  subdivided  by  Technology,  Organizational 
Affiliations,  Economics  and  Services.  Some  events  appear  on  the  tables  more 
than  once,  as  they  Impact  on  more  than  one  area. 

2,1.3  Probable  Timing  of  Round  II  Events 

Participants  were  asked  to  project  three  dates  for  each  event;  a 
date  of  20%  probability  of  occurrence,  a date  of  50%  probability,  and  a date  of 
90%  probability.  As  a relative  indicator,  the  50%  probability  averages  give  a 
fairly  consistent  picture,  and  as  such  they  are  used  here  as  an  index  of  probable 
timing.  Actual  forecast  dates  are  provided  in  Appendix  A. 

The  events  considered  likely  to  occur  soonest  (by  1985)  by  the  Round  II 
Panel  (Technology  Experts)  were  the  following  (average  50%  probability  dates 
in  parentheses): 

• TVo  tiers  of  information  providers:  "wholesalers"  and 

"retailers"  (1980) 

• Automatic  retrieval  systems  with  built-in  monitoring 
features  (1981) 

• Standardized  citation  formats  for  report  literature  (1982) 

• Standardized  abstract  formats  for  report  literature  (1982) 

• Duplication  in  acquisition  among  data  bases  will  be 
eliminated  (1983) 

• Minicomputers  coupled  with  peripherals  will  take  over 
mapy  functions  (1983) 

• Personal  interactive  terminals  will  be  available  for 

less  than  $500  (1983) 

The  events  Judged  to  take  place  in  the  most  remote  future  (beyond 
1995)  were: 


• Paper  will  be  replaced  as  document  storage  medium  by  full 
text  digital  media  (1997) 

• Access  to  full' text  data  bases  will  replace  abstracting  and 
indexing  as  searching  tools  (1997) 


• Standardization  will  allow  data  bases  to  be  merged  into 
a single  file  (2000+) 

• Paper  will  be  replaced  as  document  dissemination  medium 
by  full  text  digital  media  (2000+) 

The  remaining  events  were  all  judged  to  have  a 50%  possibility 
of  occurring  between  the  mid  1980's  and  the  1990* s. 

Actual  estimated  dates  for  events  are  shown  in  Appendix  A and 
Appendix  B together  with  the  completed  results  of  the  "A"  Event  List  and 
the  "B"  Event  List. 

2.2  COMPARISON  BETWEEN  ROUND  IIA  AND  ROUND  I IB 


Of  the  38  events  considered  in  Round  II,  20  events  (representing 
26  possibilities)  were  submitted  to  both  the  "A"  panel  (Information  technology 
experts)  and  the  "B"  panel  (planners  and  administrators).^  Seven  events 
appear  only  on  the  "A"  list  and  eleven  appeared  only  on  the  "B"  list. 

Appendix  A indicates  the  events  submitted  to  each  group. 

2.2.1  Importance 

The  Round  IIB  panel  (administrators  and  planners)  tended  to  ascribe 
"importance"  to  more  events  than  the  Round  llA  panel  (technologists).  Specifically, 
of  the  26  events,  analyzed  for  both  lists,  16  rated  higher  in  importance  in 
Round  IIB  than  in  Round  IIA,  eight  rated  higher  in  Round  IIA  and  two  were  rated 
equal  in  importance  in  both  groups. 

These  data  are  not  surprising.  It  was  anticipated  that  the  "Importance" 
of  the  events  would  be  assessed  in  terms  of  the  benefits  that  would  be  inferred 
from  their  coming  to  be.  Of  the  two  panels  in  Round  II,  the  planners  and 
administrators  of  large  information  systems  (the  Round  IIB  panel)  are  apt  to  be 
more  comfortable  with  anticipating  the  potential  benefits  of  new  technological 
developments.  Therefore,  they  saw  more  events  as  "Important." 
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Two  of  the  events  common  to  both  lists  had  four  parts  each.  For  purposes 
of  analysis,  the  parts  were  treated  as  separate  events,  bringing  the  number 
of  common  events  to  26. 


Tlie  technology  itself  appears  to  lack  Importance  In  the  judgement 
of  the  Round  II  panels  without  the  inference  of  useful  applications. 

Despite  the  fact  that  the  importance  ratings  of  the  B panel  were 
higher  than  the  A panel,  both  groups  ascribed  a fairly  consistent  ordinal 
ranking  to  the  events,  which  produced  the  composite  results  discussed  in 
Section  2.1.1. 

Events  on  which  the  importance  assessments  of  the  two  panels  con- 
trasted strikingly  were  few. 

Only  one  event  was  highlighted  by  the  Round  IIA  panel  alone: 

• Paper  replaced  as  a document  dissemination  medium  by  microform 
Events  highlighted  by  the  Round  IIB  panel  alone  included: 

• Machine  readable  storage  media  competitive  with  paper 

• Machine  readable  files  transferred  electronically,  competitive 
with  postal  service 

• Majority  of  remote  retrieval  done  via  dial-up  lines 

• Facsimile  transmission  competitive  with  postal  service  in 
cost 

2.2,2  Desirability 

Opinions  varied  widely  among  all  participants  of  both  groups  as  to 
the  desirability  of  individual  events.  However,  a similar  pattern  was  exhibited 
as  that  seen  for  the  "importance"  designation.  Of  26  events  analyzed,  15  rated 
higher  in  desirabilicy  in  Round  IIB  chan  in  Round  IIA,  seven  rated  higher  in 
desirability  in  Round  IIA  than  in  Round  IIB,  and  four  were  judged  about  equal. 

The  events  considered  more  desirable  in  panel  A chan  by  panel  B 

were : 


• Paper  replaced  as  numeric  dissemination  medium  by  microform 

• Paper  replaced  as  document  dissemination  medium  by  microform 
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• Use  of  cotnmerclally  available  software  replacing  all  original 
software  development 

the  events  $een  as  considerably  more  desirable  by  panel  B than 
by  panel  A were: 

• Numeric  data  processing  will  equal  bibliographic  data 
processing 

• Many  data  bases  accessible  through  a single  on-line  terminal 

a Automatic  retrieval  systems  with  built-in  monitoring  features 

a Personal  Interactive  terminals  as  conmon  as  automatic  typewriters 

2.2.3  Feasibility 

In  feasibility,  panel  B again  tended  to  rank  events  higher  than  panel  B. 
Of  the  twenty  six  events,  thirteen  were  rated  higher  In  feasibility  by  panel  B 
than  the  panel  A,  eight  were  rated  higher  In  feasibility  In  the  panel  A than 
panel  B,  and  five  were  rated  about  equal  In  feasibility  by  both  groups. 

Events  seen  as  considerably  more  feasible  by  Group  A than  by  Group  B 

were : 

• Machine  readable  storage  media  for  text  competitive  w.th 
microfilm 

• Machine  generaced  index  data  virtually  eliminating  manual 
Indexing 

• Commercially  available  software  virtually  replacing  original 
software  development 

• Standardized  user  protocols  adopted  by  all  technical 
Information  services 

• Conversational  and  tutorial  on-line  capabilities  will  make 
Intermediaries  unnecessary 

Events  seen  as  considerably  more  feasible  by  panel  B chan  panel  A 

were: 


• Machine  readable  records  electronically  transferred  between 
locations  at  low  cost 

• Personal  interactive  terminals  conmon 

• Paper  virtually  replaced  as  document  dissemination  medium  by 
microform 
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• Information  systems  allowing  user  to  specify  output 
format 

• Researchers  having  access  to  data  bases  of  validated  numeric 
data 

2. 2. A Probable  Timing 

The  Round  IIA  panel  and  the  Round  TIB  panel  were  relatively  consistent 
in  their  forecasts  of  timing.  The  average  forecast  ranges  of  each  panel,  for 
each  event,  tended  to  overlap  with  the  average  data  points  for  20%  probability, 
50%  probability  and  90%  probability  falling  within  5 years  of  each  other.  The 
Round  IIB  panel  (planners  and  administrators)  tended  to  be  somewhat  more 
optimistic  than  the  Round  IIA  panel  (technology  experts).  Ten  of  the  26  compar- 
able events  were  forecast  to  occur  sooner  by  panel  B.  Only  four  events  were 
forecast  to  have  a more  proximate  probability  of  occurance  by  panel  A than  by 
panel  B.  Twelve  were  forecast  approximately  even  by  both  groups. 

Notable  differences  (more  than  10  years)  in  the  50%  probability 
forecasts  of  the  two  panels  are  these: 

• Events  judged  to  be  more  proximate  by  panel  A were: 

- Machine  readable  storage  competitive  with  paper 
(panel  A - 1985;  panel  B - 1996) 

- Standardization  allowing  data  bases  to  be  merged  into 

a single  file  by  user  organizations  (panel  A - 1993;  panel 
B - 2080) 

• Events  judged  to  be  more  proximate  by  panel  B were: 

Personal  interactive  terminals  common  (panel  A - 2002; 
panel  B - 1985) 

Paper  replaced  as  a document  dissemination  medium  by 
microform  (panel  A - 1996;  panel  B - 1984) 

- Researchers  having  access  to  data  bases  of  validated 
numeric  data  (panel  A - 2003;  panel  B - 1989) 

2 . 3 CCMPARISON  BETWEEN  ROUND  I AND  ROUND  1 I 


Since  many  events  were  rewritten  following  Round  I,  and  some  were 
eliminated,  exact  comparisons  of  results  between  Round  I and  Round  II  are  not 
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possible.  However,  a rough  comparison  could  be  made  between  similar  events. 
The  "importance"  parameter  was  not  measured  in  Round  I,  thus  comparison  was 
made  in  terms  of  desirability,  feasibility,  and  probable  timing. 


2.3.1  Desirability  and  Feasibility 

Of  the  thirty-six  separate  events  were  similar  enough  between  Round  I and 
II  to  be  compared,  12  were  Judged  equally  desirable  and  feasible  by  Round  I 
and  II,  18  were  Judged  generally  more  desirable  and  feasible  by  Round  I than 
Round  II,  and  six  were  Judged  more  generally  desirable  and  feasible  by  Round 
II  than  Round  I.  However,  the  divergence  was  not  extreme  except  in  the  cases 
of  the  following  events: 

• User  organizations  able  to  merge  data  bases  into  a single  file 

• Researchers  having  option  of  data  analyses  services  through 
an  Information  analysis  center 

Both  events  were  Judged  most  desirable  and  feasible  by  Round  I, 
but  only  moderately  desirable  and  least  feasible  by  Round  II. 

2.3.2  Probable  Timing 

In  estimates  of  probably  timing.  Round  I and  Round  II  panels  were  in 
high  agreement.  For  26  of  the  36  comparable  events  the  50%  probability  forecast 
of  Rour.d  I and  Round  II  were  within  5 years  of  each  other.  Of  the  10  events 
where  the  results  differed  by  more  than  5 years,  6 were  Judged  to  be  more 
proximate  by  Round  II.  However,  the  different  estimates  were  considered  sig- 
nificant (more  than  10  years)  for  only  four  events: 

• User  organizations  able  to  merge  data  bases  into  a single  file 

(Round  I:  1983;  Round  II  = 200(H) 

• Researchers  having  option  of  data  analysis  services  through 
an  information  analysis  center 

(Round  I:  200CH;  Round  II:  1991) 

• Processing  of  numeric  data  equalling  bibliographic  data 

(Round  I;  200(H;  Round  II:  1984) 

a Researchers  having  access  to  data  bases  of  verified  numeric 
data 

(Round  I;  1996;  Round  II:  1986) 


SECTION  III.  CONCLUSIONS  AND  INTERPRETATIONS 


The  Expert  Panel  Review  Task  was  prestructured  to  highlight  gaps  In 
Information  services  and  products  resulting  from  Inadequacies  and  unresolved 
problems  In  information  technology,  organizational  structures  and  economic  and 
marketing  factors.  This  section  summarizes  the  probable  effects  that  the  fore* 
casted  state-of>the-art  will  have  on  major  Information  processing  operations  and 
plans.  Specific  DDC  Implications  are  pointed  out  as  appropriate. 

The  Interrelationships  among  events  are  presented  first  as  a summary  by 
area  • technology,  organizational  structures,  economics  and  marketing, and  services 
and  second,  as  time-phased  goals  implied  by  supporting  events. 

These  conclusions  and  goals  are  structured  to  provide  a graphic 
representation  of  realistic  expe  :tatlons  of  technological  advances  that  will 
serve  to  guide  DDC's  time  phased  planning  to  achieve  new  and  expanded  user 
services  In  the  decade  1978  to  1988  (and  beyond).  Three  time  phases  are  referred 
to  In  the  text:  short  range  - before  1983,  mid  range  - 1983  to  1995,  long 

range  - beyond  1995. 

To  sum  up  the  results  of  the  Expert  Panel  Review  Task  succinctly,  the 
gaps  In  Information  services  and  products  are  not  In  hardware  technology  but  In 
the  application  of  technology  to  user  needs.  For  example,  non-blbllographlc, 
fact  retrieval  services  are  Identified  as  an  Important  service  gap.  The  forecast 


indicates  that  advances  in  input  techniques,  communications  (in  the  broadest  sense)  and 
standardized  (or  common)  procedures  that  reduce  needless  dupl’  ion  and  errors 
of  logic  or  syntax  will  contribute  to  improving  information  services.  However, 
advances  are  not  likely  to  be  dramatic. 

3.1  TECHNOLOGY 


3.1.1  Computer  Hardware 

Large  scale,  general  purpose  computers  will  continue  to  be  utilized 
for  bibliographic  as  well  as  other  types  of  storage  and  retrieval  in  the  next 
decade.  It  appears  quite  unlikely  as  well  as  basically  unnecessary,  that  computer 
systems  will  be  designed  specifically  for  bibliographic  applications. 

Patterns  are  evident  that  indicate  complete  electronic  control  over 
information  processing  operations  is  desirable.  The  feasibility  of  complete  con- 
trol is  questioned,  but  partial  control  over  sub- functions  is  increasingly  going 
to  involve  automation.  The  probability  that  technological  growth  will  be 
piecemeal  implies  that  systems  will  soon  enter  a development  phase  favoring 
decentralization  and  distributed  processing. 

Already  emerging  are  new  applications  in  peripherals  which  may  be 
especially  adapted  for  bibliographic  and  full  text  processing,  notably  optical 
character  recognition  input  devices  (OCR)  and  word  processing  equipment.  Word 
processing  Is  seen  as  a development  particularly  worth  watching,  since  the  product 
Is  then  put  Into  machine  readable  form  at  Its  source.  OCR,  by  contrast,  is  an 
after-the-fact  procedure  of  converting  text  to  machine-readable  forms.  It  Is 
unlikely,  however,  that  either  process  will  be  really  widespread  before  the  late 
1980 's,  due  to  human  engineering  problems.  Incompatible  equipment  produced  by 
different  manufacturers,  lack  of  standardization,  unwillingness  of  potential 
buyers  to  commit  funds,  and  general  unsureness  of  how  exactly  to  use  such 
equipment  most  effectively  were  It  to  be  acquired.  Automatic  text  Input  devices 
are  seen  as  potentially  desirable  and  only  slightly  ahead  of  the  current  state- 
of-the-art. 

Another  potential  and  quite  controversial  development  In  peripherals 
Is  the  Inexpensive  "personal"  Interactive  computer  tezmlnal.  Many  experts  see 
this  as  unnecessary  and  a burden  on  any  researcher  who  must  so  cope  without  an 
Intermediary  to  do  his  Information  searches  for  him.  Other  Information  pro- 
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fesslonals  foresee  favorable  effects  including  possibilities  for  teleconferencing. 
Whether  or  not  the  "personal"  terminal  becomes  a reality,  however,  interactive 
terminals  will  proliferate  and  be  more  available  to  all  researchers  in  the  next 
decade.  Interactive  terminals  and  other  types  of  peripherals  may  also  be  coupled 
with  minicomputers  (and  eventually,  micro  computers)  for  applications  such  as 
data  manipulation,  intermediate  data  processing,  and  local  data  control. 

A number  of  new  computer  memory  technologies  are  being  developed 
(holographic,  "bubble,"  etc.)  but  are  unlikely  to  affect  standard  data  processing 
techniques  for  quite  some  time.  Associative  memories,  however,  (a  very  fast 
parallel-processing  type  of  memory)  are  likely  to  be  of  some  auxiliary  use  in 
information  processing  by  the  early  1990's.  These  memories,  too  expensive  to 
consider  for  bulk  storage,  have  a useful  potential  as  hardware  support  for  software 
"macro"  instructions  and  for  index  table  processing  in  information  retrieval  pro- 
cedures. 

3.1.2  Computer  Software 

In  software,  machine  independence  is  seen  as  a useful  trend.  However, 
it  is  regarded  as  a mid-range  achievement,  delayed  into  the  1990's  by  inherent 
inefficiencies  of  machine  independent  software. 

Purchasing  software  packages  is  seen  as  a desirable  alternative  to 
de  novo  programming.  Packages  with  monitoring  and  tutorial  features  for  on-line 
interactive  systems  can  be  available  in  the  short  range.  The  development  of 
useful,  commercial  packages  la  regarded  as  feasible  if  DDC  or  similar  Influential 
agencies  could  define  the  requirements  in  their  area  and  thus  offer  an  incentive 
to  potential  vendors  to  develop  such  packages.  The  Importance  of  on-line 
tutorial  assistance  is  linked  to  the  growth  of  personal  interactive  search  ser- 
vices. 


3.1.3  Communications 


Total  electronic  point-to-point  communication  is  seen  as  highly  desirable. 
For  example,  the  highest  ranked  event  in  importance  was  "Interactive  access  to  full 
text  data  bases  replacing  abstracts  and  indexes  as  searching  tools."  Supporting 


events  leading  toward  that  all  encompassing,  long-range  event  show  a set  of  short 
and  mid  range  achievements  including  widespread  availability  of  personal  terminals, 
dial-up  communication  systems,  electronic  file  transfer  at  reasonable  cost 
and  facsimile  transmission  of  supporting  material.  In  all  casee^  microform  communlca 
tlon  and  paper  were  seen  as  limited  use, Interim  communication  media.  It  is 
probable  that  in  the  long-range,  microforms  will  be  virtually  replaced  by  digital 
media  with  paper  fulfilling  a basic  function  unsulted  to  any  medium  other  than 
paper.  (For  example,  work  in  progress  records) 

3.1.4  Information  Storage  and  Dissemination  Media 

Microform  will  be  the  prime  storage  medium  for  large  bibliographic 
files  for  at  least  the  next  decade.  Beginning  in  the  1980' s,  machine  readable 
digital  storage  will  begin  to  be  competitive  on  a cost  basis  with  paper  and 
microform.  Gradually,  digital,  machine  readable  file  storage  will  replace  present 
day  file  techniques.  The  probable  sequence  will  be  numeric  data  files  first,  then 
bibliographic  surrogate  files  (Indexes  before  abstracts)  and  ultimately  full 
text  files.  However,  the  opinion  of  the  members  of  the  panel  Is  that 
no  media  will  ever  completely  replace  or  be  more  acceptable  than  paper.  Therefore, 
ODC  should  always  consider  ways  that  permit  Individuals  to  select  or  regenerate 
paper  copy  from  bibliographic  system  output  files. 

3.2  ORGANIZATIONAL  STRUCTURES  AND  AFFILIATIONS 

The  Expert  Panel  Review  task  emphasized  technology  and  services.  Thus, 
only  two  organizational  issues  were  .'lubmltted  to  panel  reviews  - standardization, 
and  whether  DDC  should  be  acting  as  a "wholesaler"  of  Information  or  a "retailer" 
(dealing  directly  with  users). 

Standardization  events  are  regarded  among  the  most  important.  Standardize 
tlon  Is  regarded  as  most  desirable  and  feasible  with  standardization  of  citation 
data  somewhat  more  feasible  than  standardization  of  abstracts.  However,  there  is 
a counter- influence  indicated  In  several  events  that  Indicate  a preference  for 
Independent  operations.  For  example,,  standardized  vocabularies  and  merged  data 
bases  are  regarded  as  relatively  unimportant  and  only  moderately  desirable. 
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Consequently,  standardization  should  not  be  viewed  as  part  of  a move  toward 
coalescence  and  some  form  of  a consolidated  national  system  but  rather  as  a 
matter  of  common  Interest  to  facilitate  interagency  communication  and  informa- 
tion exchange. 

Similarly,  information  processing  organizations  acting  exclusively  as 
"wholesalers"  or  "retailers"  is  an  unlikely  and  undesirable  event.  Technological 
and  applications  gaps  will  prevent  adequate  direct  service  to  users  being  pro- 
vided exclusively  from  remote,  central  information  resources.  Thus,  for  the 
foreseeable  future,  large  processors,  such  as  DDC,  must  function  with  a structure 
that  permits  and  encourages  smaller  or  more  specialized  information  agencies 
to  deal  directly  with  users  even  if  the  central  agency  elects  co. provide  some 
"retail"  services  directly  to  users. 

Frequent  and  intensified  cooperative  efforts  are  forecast  as  desirable 
and  feasible,  particularly  among  agencies  with  complementary  capabilities.  For 
example,  DDC's  cooperative  efforts  with  NASA  and  Its  plans  to  utilize  the 
ARPANET  to  broaden  Its  service  range  were  cited  as  favorable  developments. 

On  the  questions  Involving  interaction  of  data  bases,  the  character 
of  "independence  with  cooperation"  was  seen.  Feasible  events  point  toward 
developing  algorithms  and  methodologies  for  translating  between  different  data 
formats,  thus  ensuring  a workable  measure  of  compatibility  without  rigid  inter- 
agency standardization. 

3.3  ECONOMICS 

3.3.1  Costs 

Cost  factors  are  not  Inherent  barriers  to  advancing  Information  tech- 
nology. Notably,  no  event  directed  at  cost  Issues  was  rated  among  the  top  20% 
In  Importance  regardless  of  the  level  of  desirability  and/or  feasibility. 
Naturally,  downward  cost  trends  were  regarded  as  desirable.  In  fact,  downward 
costs  are  forecasted  because  of  Increased  production  and  more  widespread  use  of 
digital  technologies  which  will  result  In  lower  costs  per  unit  for  hardware  and 
software  (In  terms  of  current  dollars).  Communications  costs  will  also  drop, 
although  not  Indefinitely. 
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Beyond  the  data  of  the  Expert  Panel  Review,  conjecture  suggests 
that  lower  costs  and  more  efficient  hardware  are  insufficient  and  possibly 
inappropriate  objectives  as  such  for  the  information  community.  Despite  success 
after  success  in  hardware,  and  to  a lesser  extent  software  (much  of  which  is 
a direct  result  of  Government  underwriting  of  development  costs),  the  essential 
problems  of  intellectual  information  transfer  are  identified  as  the  "important" 
gaps  in  information  technology.  Syatem  design  problems  involving  machine -machine 
interface,  man-machine  interface  and  interorganizational  interaction  are  consistently 
highlighted  in  the  Expert  Panel  Review  rounds. 

From  past  experience,  represented  in  the  opinions  of  the  panel  members, 
quantum  Improvements  in  information  processing  technology  will  not  result  from 
more  automation  alone.  More  sophisticated,  total,  and  human-sensitive  design 
concepts  are  required  than  have  been  employed  to  date. 

Given  these  conjectural  circumstances,  priorities  for  R & D funding 
ought  to  emphasize  projects  directed  toward  more  effective  utilization  of 
state-of-the-art  technology  over  developing  new  capabilities  of  hardware  and 
software.  Particularly,  funding  should  be  directed  toward  research,  design 
and  testing  of  new  and  more  effective  interactive  technologies  involving 
machine-machine  interface,  man-machine  interface  and  organization-organization 
interface. 


3.3.2  Source  of  Funding  for  Information  Services 

That  federal  technical  information  services  become  self-supporting 
is  regarded  as  undesirable  and  unfeasible.  Both  R & D funding  and  operating 
costs  are  likely  to  require  at  least  partial  subsidy.  The  perception  of  a 
relationship  between  information  services  and  accrued  benefits  is  at  best 
tenuous.  Thus,  efforts  to  achieve  total  cost  recovery  are  likely  to  retard 
experimentation  with  new  concepts  and  services  at  a time  when  such  experimenta- 
tion is  seen  as  essential  to  real  progress  in  information  processing  technology. 

3.4  SERVICES 


Events  directed  toward  identifying  conceptual  gaps  in  the  nature  of 
information  services  received  the  highest  ratings  in  importance  (first  and 
second).  However,  it  is  disappointing  (as  well  as  enlightening)  that  the  panels 


were  very  pessimistic  about  the  prospects  for  bridging  the  gaps  before  1995. 

Three  conclusions  stand  out: 

• Access  to  complete  information  is  needed  (surrogates  are  only 
useful  Intermediate  tools) 

• Services  have  to  be  interactive 

• Researchers  need  access  to  factual,  verified  data 
3.4.1  Accessibility  to  Information  Resources 

Panelists  in  each  of  the  Rounds  stressed  the  need  for  users  to  have 
access  to  comprehensive  information.  It  is  desirable  and  feasible  that  the  logi- 
cal strategy  to  accessing  comprehensive  Information  stores  appear  direct  and 
"simple"  to  the  user.  While  many  events  imply  that  in  the  long  range,  total 
electronic  control  and  manipulation  of  information  processas  will  provide  the 
means  for  accomplishing  widespread  comprehensive  accessibility,  it  is  forecast 
that  to  maintain  the  appearance  of  simplicity,  human  Intermediaries  will  be  most 
desirable  for  the  short  and  mid  range  periods.  The  human  intermediary  is  seen 
as  essential  . He  may  be  an  information  specialist  or  an  R & D user  sophisticated 
in  Information  processes  who  will  be  able  to  translate  man-machine  communication 
and  act  as  a logical  connecting  node  in  an  accessible,  but  complicated  technical 
information  coranunity  which  will  persist  into  the  1990's. 

The  ability  to  address  the  complete  technical  information  record 
(i.e.,  all  possible  technical  information  files)  was  regarded  as  only  one 
aspect  of  ensuring  accessibility  to  Information  resources.  Equally  important 
is  the  ability  to  pursue  an  interactive  search  strategy.  Broad  accessibility 
is  implied  by  comprehensive  addressibillty.  Precise  accessibility  is  provided 
by  iteration.  Thus,  an  interactive  type  of  information  system  is  the  most 
preferred  mode  of  operation.  Interaction  can  exist  at  several  levels.  It 
usually  is  taken  to  refer  to  the  ability  of  a terminal  user  to  address  and 
define  succeeding  subsets  of  a master  file  in  a dialog  type  of  interaction. 

More  sophisticated  interaction  can  involve  machine-to-raachine  interaction  and 
inter-file  interaction  (e.g.,  use  of  multiple  files  accessed  in  a number  of 
independent  locations)  on  an  a^  hoc  basis. 
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In  the  long  term,  both  broad  and  deep  accessibility  should  be  pro- 
vided in  order  to  provide  the  full  scope  of  services  required  by  technical 
information  users. 

3.4.2  Fact  Services 


The  most  conspicuous  gap  in  information  services,  according  to  the 
Expert  Panel  Review,  is  fact  information.  Fact  information  Includes  numeric 
values  and  also  pieces  of  discrete  data  capable  of  satisfying  inquiries  without 
further  reference.  The  technology  is  estimated  to  be  capable  of  supporting 
such  a service  and  it  is  rated  moat  desirable  and  extremely  important.  Yet, 
the  probable  timing  places  this  as  a mid  to  long  range  event. 

This  event  must  be  regarded  as  a high-payoff  area  for  DDC  to  pursue. 

There  appears  to  be  no  explanation  for  the  lack  of  progress  in  fact  services 
other  than  neglect  on  the  part  of  the  information  planners  and  designers. 

3.4.3  Information  Analysis 

Information  analysis,  like  fact  retrieval, is  an  extension  of  information 
services  that  goes  beyond  citations  and  document  retrieval.  This,  too,  is  an 
event  that  was  regarded  by  the  panels  to  be  "important".  However,  it  is  interest- 
ing that  it  was  considered  to  be  only  "moderately  desirable"  and  "least  feasible" 
as  a service  for  "all  researchers."  It  appears  that  information  analysis  is  a 
service  to  be  offered  judiciously. 

Alternative  Interpretations  inferred  from  these  results  suggest  two 
DDC  options.  DDC  can  build  on  its  present  referral  service  and  become  a centralized 
referral  center  for  information  analysis.  This  option  requires  that  DDC  be 
able  to  provide  expert  consultation  on  the  various  capabilities  of  information 
analysis  centers.  Computerized  listings  of  selected  names  of  centers  meeting 
search  paramete-*- ■ is  not  sufficient.  Users  need  interactive  dialog  to  be 
able  to  assess  the  appropriateness  of  various  information  centers  for  their 
needs  of  a given  moment. 

A second  alternative  is  for  DDC  to  sponsor  or  establish  and  maintain 
an  information  analysis  center  covering  subjects  of  general  interest  or  multi- 
disciplinary fields  not  adequately  provided  for  by  the  specialized  information 
analysis  centers  currently  sponsored  by  DoD. 
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TIME-PHASED  GOALS  AND  SUPPORTING  EVENTS 


A key  objective  of  the  Expert  Panel  Review  was  to  develop  a time 
phased  structure  to  the  forecasted  technological  advancement  of  information 
processing.  This  section  takes  the  findings  and  conclusions  previously  dis- 
cussed and  adds  a sense  of  prioritization. 

The  two  parts  of  this  section  present  the  events  of  the  Expert  Panel 
Review  in  terms  of  prioritization  by  relative  Importance  and  prioritization  by 
time  phased  goals. 

3.5.1  Prioritization  by  Order  of  Importance 

The  Expert  Panel  Review  task  resulted  In  a well  distributed  order  of 
Importance  to  the  events  submitted  for  review.  Figure  3-1  Illustrates  the 
distribution  of  events  according  to  the  "Importance"  rating  ascribed  by  the 
Round  II  pe^'t  15  events  were  Judged  "Important?' by  60%  of  the  panel,  9 events 
by  70%  of  tht  nel  and  one  event  each  by  80%  and  90%  of  the  panel,  respectively. 


Percentile  Indicated  "Important" 

Figure  3-1.  Distribution  of  Events  by  Importance 

Eleven  events  in  the  70  to  90  percentile  made  up  the  top  20%  of 
events  by  importance.  They  also  represented  the  down  slope  on  the  distribution 
curve  (i.e.,  the  above  average  "important"  events).  Thus,  these  11  events, 
shown  in  Figure  3-2»were  chosen  as  a select  set,  which  were  interpreted  to  be 
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Figure  3-2.  Most  Important  Events 


Flgjre  3-2.  (Continued) 


the  appropriate  events  to  govern  the  direction  of  information  technology  that 
would  be  most  likely  to  result  in  quantum  Improvements  in  information  processing 
technology. 

The  events  are  evenly  distributed  between  technology  and  aervlcea  with 
standardization  achievement  acting  as  a sort  of  bridge.  Achievements  of  cost 
related  events  are  notably  lacking  in  the  list  of  "important"  events. 

3.5.2  Time~Phased  Goals  and  Supporting  Eventi 

Using  the  most  important  events  (top  20%X  four  principal  time  phased 
goals  are  recommended  that  should  characterize  DDC's  long  range  planning. 

• Achieve  complete  electronic  control  over  information  processes 

• Provide  a comprehensive  international  cross  disciplinary  and 
integrated  data  resource  that  will  be  accessible  to  individuals 
through  single  access  points 

0 Provide  non-bibliographic  services 

• Provide  information  analysis  services 

These  goals  and  their  supporting  events  are  shown  in  Figure  3-3. 

The  order  shown  is  by  probable  timing.  As  can  be  seen  in  the  graphic  representa- 
tion, there  is  a wide  range  forecasted  for  some  events.  But  the  50%  probable 
timing  estimated  is  used  as  a guide  to  planning. 

As  with  all  forecasts  and  most  goals,  unforeseen  developments  can 
alter  the  predicted  course  of  events.  Hox^ever,  until  such  time,  the  outline 
depicted  in  Figure  3-3  represents  the  most  reasonable  forecast  of  the  course 
that  information  processing  technology  will  take  through  the  next  several 
decades. 
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APPENDIX  A.  DATA  TABULATION 


TAnu:  A-l  . Tl-XIIMOI^CY 


Iiiinortance  I Timin 


Most  Desirable  and  Most  Feasible 

1.  Most  technical  Information 
retrieval  by  dial-up  communica- 
tion lines 

2.  Facsimile  transmission  competi- 
tive with  postal  service  in  cost 


3.  Paper  will  be  replaced  as  prim- 
ary numeric  storage  medium  by 
digital  media 

4,  OCR  able  to  convert  any  docu- 
ment to  machine  readable  form 


5.  Word  processing  equipment  making 
available  machine  readable  full 


Host  Desirable  and  Moderately 
Feasible 

6.  Machine  readable  storage  media 
competitive  with  paper 


7.  Files  electronically  transferred  7 
between  different  locations  at 

low  cost 

8.  Commercial  software  packages  2 

replacing  most  original  soft- 
ware development 

9.  Most  packaged  software  machine  2 
Independent 


Moderately  Desirable  and  Most 
Feasible 

10.  Machine  readable  storage  com- 
petitive with  microfilm 


TABLE  A-1.  TECHNOLOGY  (Continued) 


Importance 


Timln 


11.  peripherals  with  minis  will 
take  over  many  automated  func- 
tions 

12.  Interactive  computer  terminals 
available  for  $500. 


13.  High  quality,  low  cost  micro- 
film reader-printer  avail- 
able 


14.  Paper  replaced  as  document 
storage  medium  by  microforms 


15.  Automatic  monitoring  built  In-  16 
to  retrieval  systems 


16.  Paper  replaced  as  numeric 
dissemination  medium  by 
digital  media 

Least  Desirable  and  Most  Feasible 


17.  Paper  virtually  replaced  as  a 
numeric  dissemination  medium 
by  microform 

Moderately  Desirable  And 
Moderately  Feasible 


18.  Associative  memories  commonly 
used  for  machine-aided  fact 
retrieval 


1982 

1992 

2000+ 


19.  "Personal"  Interactive  termin- 
als very  common 


20.  Paper  replaced  as  document 
storage  medium  by  full  text 
dlgltol  media 


HVl'NT 
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Importance 


Timin 


— 
21.  Acceptable  machine  generated 

1 

18  J 18 

78% 

1980 

Index  data 

1 

1986  M 

I 

1 

1998 

22.  Tutorial  features  of  on-line 

24  ! 22 

58% 

1981 

systems  making  Intermediaries 

1 

1988  M 

unnecessary 

1 

1 

1996 

Moderately  Desirable  and 

1 

1 

Least  Feasible 

1 

1 

1 

23.  Associative  memories  will  be 

1 

4 ; NA 

44% 

1984 

commonly  used  In  machine 

1 

1 

1995  M 

aided  retrieval 

1 

1 

1 

2000+ 

Least  Desirable  and 

1 

1 

1 

Moderately  Feasible 

1 

1 

• 

24.  Paper  replaced  as  document 

14b  ! 11b 

34% 

1981 

dissemination  medium  by  micro- 

1 

1 

1990  M 

form 

• 

t 

I 

1998 

25.  Paper  replaced  as  numeric 

1 

1 

1 

1981 

storage  medium  by  microform 

I7a  1 I4b 

46% 

1988  M 

1 

1 

1 

1992 

Least  Desirable  and  Least  Feasible 

1 

1 

1 

1 

26.  Computers  designed  specif Icall) 

1 I NA 

20% 

1980 

for  bibliographic  storage  and 

1 

1 

1984  L 

retrieval 

1 

1 

1 

1988 

27.  Paper  replaced  as  document  dls- 

14d  j lid 

65% 

1989 

semination  medium  by  full  text 

1 

1 

2003  L 

digital  media 

1 

• 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

t 

1 

1 

1 

1 

1 

1 

1 

I 

1 

1 

2028 
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TABLE  A-2.  ORGANIZATIONAL  AFFILIATION 


Importance  I Timin 


Most  Desirable  and  Most  Feasible 


28.  Standardized  citation  formats 


29.  Standardized  abstracts  formats 


Most  Desirable  and  Moderately 


Feasible 

30.  Standardized  user  protocols 
for  on-line  retrieval  system 


Moderately  Desirable  and  Most 


Feasible 

31.  Two  levels  of  Information 
providers  - wholesalers/ 
retailers 

Moderately  Desirable  and 


Moderately  Feasible 


32.  Unnecessary  data  base  duplica- 
tion eliminated 


Moderately  Desirable  and 
Least  Feasible 

33.  Standardization  allowing  user 
organizations  to  merge  data 
bases  into  a single  file 

Least  Desirable  and 
Moderately  Feasible 

34.  Decentralized  Input  processing 
for  large  IS&R  systems 
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TABLE  A- 3.  ECONOMICS  AND  MARKETING 


I'Vl'NT 

Af?  ! 

Importance 

Timinc 

Most  Desirable  and  Most  Feasible 

t 

1 

1 

1 

1 

36.  Facsimile  transmission  com- 

13  ! 10 

60% 

1981 

petltlve  with  postal  service 

1 

• 

1987  M 

In  cost 

1 

1 

< 

1995 

Moderately  Desirable  and 

1 

Most  Feasible 
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TABLE  A-4.  SERVICES 


Importance  I Timin 


Most  Desirable  and  Most  Feasible 

40,  Accessibility  of  many  data 
bases  through  a single 
terminal 

Moat  Desirable  and  Moderately 
Feasible 

41.  Major  IS&R  systems  allowing 
choice  of  output 


42.  Researchers  have  access  to 
data  bases  of  factual,  veri- 
fied data 

Moderately  Desirable  and  Most 
Feasible 

43.  Interactive  access  to  citatior 
data  bases  replacing  abstract: 
and  indexes  as  searching  tool: 

Moderately  Desirable  and 
Moderately  Feasible 


44.  Personal  interactive  terminals 
very  common 


45.  Tutorial  features  of  on-line 
systems  making  intermediaries 
unnecessary 

46.  Interactive  access  to  full 
text  data  bases  replacing 
abstracts  and  indexes  as 
searching  tools 

Moderately  Desirable  and  Least 
Feasible 

47.  Information  synthesis  and 
analysis  available  to  all 
researchers 


TABLE  A-4.  SERVICES  (Continued 


Least  Desirable  and  Moderate I 


Feasible 


48.  Processing  of  numeric  data 
at  least  equal  to  .the  pro- 
cessing of  blbllograpb'*  c 
information 

Least  Desirable  and  Least  Feasible 


49.  Dissemination  of  full  text 
of  documents  precluding  need 
for  abstracts  as  announce- 
ment devices 

50.  Dissemination  of  full  text 
of  documents  precluding  need 
for  abstracts  as  retrieval 
devices 
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TABLE  A~6.  DISTRIBUTION  OF  EVENTS  BY  ORDER  OF  IMPCTITANCE 
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minis  are  for  local  control  - not  computation.  2}  Big  computers  will  be  transformed  into 
mini-computer  networks  by  1985.  3)  By  1990  it  will  be  microcomputers. 
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it  required  if  data  bases  are  used  by  differeat  groups.  3)  The  reverse  will  take  place;  data  of 
complex  structure  will  evolve.  4)  Storing  data  in  standard  formats  is  done  now. 
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I)  Terminal  users  may  not  be  as  common  as  typists'  2)  Will  further  depersonalize  work.  3)  Little 
need.  Users  can  use  calculators.  Re  record  keeping,  most  Individual's  records  aren't  that  complex 
4)  The  communication  costs  are  the  bottleneck. 
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advantages  to  be  "virtually  replaced."  Non-paper  will  Increase  markedly,  but  statement  is  too  strong. 
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Done  now  with  ARPANET.  Need  and  economics  must  justify  costs.  "Private  enterprise"  factors  and  the 
number  of  data  bases  involved  will  slow  down  this  development , however. 
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Differenc  conioeats:  1)  ...and  automatic  reporting  to  the  authorities  of  stupid  or  dangerous  requests^ 

2)  This  exists  now.  3)  This  one  isn't  too  big  a problem. 
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l)  Hand-held  calculator/numeric  stores  will  completely  replace  paper  for  computation  as  soon  as 
available.  2)  "Same  ronments  as  14" 


u 

« 

x:  0) 

4J  > 

« a 
j:  X M 
u 

n I-* 

^ -H  rH 

y ' *r» 

•H  >%  » 

^ W 

3 -rl  ^ • 

r^^  e "O 
>1^  « « 
U3  ^ > W 
c«  4» 

M ^ 9 

« O Oj  U 
4t  M C O 
><  O.  4J  O 


(OI-l  3IB38  UO) 

-<3TT?qT8»aj 


(0I“T  91*38  UO) 
^3TITq9aT89a 


(O  JO  X) 

iJusAa  jofvyi 


JS 

^ i 

fi  ^ . 

o o e 

0<  -H  O • 
« 4J  • 
M <0  <M 

y i4 

(4  e 4J  ■ 
J V I«  • 
00t» 

9 I 

jc  a X 
O G V 
«l  -H  *0  ■ 
U M P 

O f< 

•V  « • 

9 6 V • 

IQ  M • 

« .O 

u £ (0 

•<^  4i  4J 
ku  0< 

••-I  • 4) 

U 4>  O 
9 Vi  U 
9 9 rt 

■r<  4J  I I 
U 9 4)  . 
W V<  W 
4>  9 ‘ 
Vi  U 


G . 

•.  1 • 
/-s  eg 

(0  <n  c 
(0  o 


eg . (J  <g 
3 X U 
>->  V o 
we 
c e 
/-«.  o o 

04  U U 

0)  »-4 
• JS  9' 

4J  VI  3 

u u 
« 41  X 
Vi  t*  4> 
V)  *H  iJ 

« > 9 
^ O O 
9 Vi  U 
Cv 

Vi  *44 
O 0 O 

VJ. 

«i>  n 
41  -VJ  -f 

m « w 
9 *0  >s 
(4  4)  »-i 

CV  C 9 

9 

9 V 
■O  fO  •« 
M VI 
O 1-4 

3 l-l  *44 
f4 

» O 
4)  VI 
Ji  --S 
U 9 

04  •'4  -i-l 

”0  9 

•W  K 

> 44 

O VI  TJ 
Vi  .9  9 
a 40  <*4 
•H 

Vi  9 04 
O Vi  j: 
VI  41  W 
-I  > 
'VOX 
44  U 
9 -rl 

5 f-g 

VI  jB  O 
O 44 
,9  *44  9 
VI  0 •w 
9 

9 44  e 

0 Vi 

*44  f4  3 

2 >1  s 

S J3  S 

ij  0 0 9 


M O 

si 

o M 


tj 

2 

> 

« . s 

4:  X ^ 
u 

« IM 

X -H 

u 

•r4  >%  » 

X U 

ft  >*4  4J  • 

r-4  e •« 
>>t4  4)  « 

<0  X 5»  H 

«5  4)  V4 

Ki  X 9 
« O « U 

5!  ii  •=  ii 

>4  Ck.  U O 


OS 

,P 

H 

X 


T3S- 

o 

J 

X 


0 

1 

X 


o 

in 

o 


os 

00 

O' 


(OI-I  »1»3»  UC) 

^3TITqT«»»i 


(01 *T  9T»3«  wo) 
^3TITqB-aT8®a 


(o  ao  X) 

iauaAg  JtofsM 


o 

00 

O' 


00 


00 


g 

r» 


M 
I '/) 

9 41 

0 t-4 

« o *0 

4)  -O  M 
U <0 
•j4  >s  00 
> J V 
« «0  >4 

e 1-4  B 

o »-4  C 
•<4  <0  0 
44  9 
f4  iJ 

B M « 

00  *H  —4 
O > X 
U 10 
4J  *j  «0 

M H 10 

t)  « 

1 

o 


u 

I 

s 

>^!c 
o 


4) 

4J 

o 

2 

« 

X '.H  <0 

o -g  a 

1-4  4>  O 
40  P 44 
U 

•r4  )-4  44 

y •"'  o 

a ‘rl  « 

o ft  a 


u 

<0 

44 

9 

u 

u 

0) 


4J 

c 

>2 

2. 


U 

U 0) 
O 4J 
u 

4J  ^ 

of  oO 


fi 


o o 

44 

r< 
44  kn 
O O' 


M 

I 

o ■ 


1)  How  could  a oacblae  read  matheokaclcal  diagrams  and  formulas?  These  could,  of  course  be  treated 
as  plctoral  data.  2)  Not  handwritten  material.  3)  Not  sure  such  versatility  of  formats  and  typt' 
fonts  may  not  be  necessary  in  most  applications.  4)  Including  plctoral  art?  Graphic  OCR  has  a 
later  set  of  probability  dates. 
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1)  Standards  will  force  user  to  conform  to  system  requirements.  2)  Data  base  techniques  are  avail- 
able now.  It  may  not  be  economically  feasible  to  implement  such  freedom,  however.  3)  May  be  more 
expensive  than  it  is  worth.  May  also  require  more  user  specifications  than  worthwhile. 
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APPENDIX  C.  ROUND  IIB  AGGREGATE  DATA  WITH  COMMENTS 
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6)  Policy,  politics,  ownership  ace  slow  to  evolve.  7)  Organizational/political  problems  present 
chief  barrier.  8)  Assume  "most"  enough  to  make  global  system  very  useful. 
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processing  costs  will  make  personal 
interactive  terminals  as  common  as 
electric  typewriters. 
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vO 

oc 

O' 


4J 

« 

ji  4) 

w > 

B Id 

Jl  X £i 

b4 

M rH 

3 a 

£ >P 

to  » 

y .P 

< M 

«p  5 

CO  £ 

.B  P 

O M 

^ *H  U * 

i H 

»-4  C T) 

S 

-H  U V 

.O  ^ > P 

B 0)  P 

U JO  3 

Id  0 y u 

V P .c  u 

>-i  B,  4J  o 

(OT-1  aiBOS  uo) 

^3T17q7SB!>j 


(01-1  oiBDS  uo) 
A3TlTqeJ7S9a 


(o  ao  X) 
i3U3A3  aofew 


41 

00  ta 

• C 

o 


» u 
P 3 
(0  O (0 

» ? ^ 
r->  e 

« .p 

» r— I 

3 “3 
-<  O O 
J3  O 
(d  (0  00 
S3 

0 w u 
P O*  O 
a 3 c5 

o 

1^  p t 

, r-l  00  i-< 

•1^ 

s to  < 
T3  £ 

01  p 
P (d 

3 TJ  <-< 

.C  3 u-i 

u cd 

u 

•>  M . 
/—  U 
y TO  >4-1 

•rl  B «d 
. « «d  P 
*0 


t 


PROBABLE 

TIMING 


3 


OJ 

X 


X 

u 


(0 


H 3 


X 

^ n 

■"I 

M X 

i«  O 

a) 

><  a.  w 


u 

C 

9) 

1 


TJ 

0) 

U 

9 

u 

o 

o 


(0I“I  3IB0S  UO) 
Xqii TqtsBDj 


(Ot't  aitJDS  UO) 

Xq-if  TqBj^saa 


(0  ao  X) 

iqUQAa  JOfBW 


human  intellectual  analysis  for  many  years.  6)  Feasible  earlier,  but  perhaps  not  very  high 
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and  would  promote  a wider  use  of  the  retrieval  system.  4)  Assume  retrieval  of  bibliographic  informa- 
tion only,  other  retrieval  protocols  will  have  to  vary  according  to  user  kind  and  need.  5)  Standaxd- 
i*«tion  should  not  prevent  optional  procedures.  6)  May  be  more  than  one  standard,  permitting  user  to 
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services.  Does  not  seem  as  relevant  to  numeric  data  base  services.  2)  As  yet  not  known  if  NASIC-like 
groups  will  remain  as  third  tier.  3)  I don't  think  this  is  exactly  the  way  things  will  go.  4)  In 
U.S.  only.  5)  There  is  much  evidence  of  this  now.  Am  I missing  so<%thing  here? 
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people  are  not  always  available.  2)  Exists  in  part  now.  3)  Expenslvel  4)  I believe  bibliographic 
references  will  not  be  largely  supplanted.  Also  there’ll  have  to  be  a lot  more  work  on  certifying 
and  validity.  5)  "Access"  may  be  highly  desirable,  while  "supplanting"  may  not  be.  6)  Confused  by 
limitation  to  numeric  data.  On-line  numeric  data  can  never  supplant  most  bibliographic  references. 
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TECHNOLOGY 
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Question: 
Event : 

Can  DDC  obtain  a computer  system  which  Is  specially 
designed  for  IS&R? 

Computers  designed  specially  for  bibliographic  storage 
and  retrieval  applications  will  be  available. 

Question: 

Will  the  digital  storage  medium  become  competitive  with 
paper  and  microforms? 

Event : 

Machine-readable  storage  media  will  be  competitive  from 
cost,  capacity,  and  access  time  standpoints,  with: 

(a)  paper 

(b)  microform 

Question: 

Can  associative  memories  be  used  for  machine-aided 
Information  analysis  and/or  retrieval? 

Event : 

Associative  memories  will  be  commonly  available  for 
use  In  machine-aided 

■ 

(a)  retrieval 

(b)  Information  analysis 

Question: 

Is  DDC's  decision  to  pursue  dial-up  access  to  unclassi- 
fied information  sound? 

Event : 

85%  of  remote  technical  Information  retrieval  will  be 
accomplished  via  dial-up  (public  switched)  communica- 
tions lines.  The  remainder  will  be  accomplished  through 
dedicated  lines. 

Question: 

Can  entire  data  files  be  electronically  transferred 
between  ODC,  NTIS,  lAC's,  users,  etc? 

Event : 

Files,  (of  the  size  equivalent  to  a reel  of  magnetic 
tape)  will  be  electronically  transferred  directly 
from  one  data  base  to  another  at  a transmission  cost 
which  Is  competitive  with  mailing  a reel  of  tape. 

Question: 

Will  the  trend  be  away  from  large,  centralized  pro- 
cessing systems  and  toward  distributed  processing 
with  minicomputers? 

Event : 

Processing  In  large  scientific  Information  systems 
will  be  performed  by  a network  of  decentralized  mini- 
computers rather  than  by  large,  centralized  computers. 

j 
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Question: 

Will  computers  be  able  to  support  a sufficient 
number  of  terminals  to  provide  a CRT  to  each  user 
who  wants  one? 

Event : 

Increased  computer  capacities  and  reduced  processing 
costs  will  allow  each  R&D  professional  to  have  his 
own  on-line  Interactive  terminal. 

Question: 

What  factors  will  influence  the  acceptability  of 
microforms? 

Event : 

A high-quality,  low  cost  (i.e.,  under  $100)  microfilm 
reader-printer  will  be  commercially  available. 

Event : 

Microforms  will  become  equal  to  paper  in  acceptability 
by  Information  users. 

Question : 

What  are  the  alternatives  to  the  postal  service  for  docu- 
ment delivery? 

Event : 

Facsimile  transmission  will  be  competitive  with  postal 
service  for  full  text  document  delivery  in  terms  of 
cost  and  speed. 

Question : 

Will  paper  cease  to  be  the  primary  document  storage 
and  dissemination  medium? 

Event ; 

Paper  will  be  replaced  as  the  primary  document  dis- 
semination and  storage  medium  by: 

(a)  Microforms 

(b)  Full  text  digital  media 

(c)  Sound  recordings 

(d)  Other  (specify) 

Question: 

How  can  DOC  get  user  feedback  without  reinitiating  user 
surveys  every  year? 

Event : 

Automatic  retrieval  systems  will  have  built  in  monitor- 
ing features,  thus  providing  Instant  analysis  of  system 
use  and  user  needs. 

Question: 

Will  paper  cease  to  be  the  primary  document  storage 
and  dissemination  medium  for  numeric  data? 

Event : 

Paper  will  be  replaced  as  the  primary  numeric  data 
storage  and  dissemination  medium  by: 

(a)  Microforms 

(b)  Digital  media 

(c)  Sound  Recordings 

(d)  Other  (specify) 

A 

MJlMftACM 


3. 

i 


^i 

i 


Question: 

Should  ODC  continue  to  support  machine -aided  indexing 
activities? 

Event : 

For  scientific  and  technical  report  literature,  the 
generation  of  acceptable  index  data  from  machine 
readable  text  will  virtually  eliminate  the  need  for 
manual  indexing. 

Question : 

Can  DDC  eliminate  duplicate  input  keyboarding? 

Event : 

Optical  character  recognition  devices  will  readily 
convert  any  document  to  machine-readable  form,  regard- 
less of  format  or  type  font. 

Event : 

Increased  use  of  word  processing  equipment  will  make 

machine  readable  versions  of  full  text  documents 

j 

readily  available. 

S 

Question : 

Can  DDC  minimize  original  software  development? 

Event : 

Use  of  commercially  available  software  packages  for 
document  storage  and  retrieval  applications  will 
virtually  replace  original  software  development. 

i 

Question; 

Can  DDC  approach  a reasonable  degree  of  computer 
manufacturer  independence? 

Event: 

All  packaged  software  will  be  machine  independent. 

Question: 

Can  the  Defense  on-line  Retrieval  System  provide  full 
conversational  capability? 

j 

Event ; 

Conversational  and  tutorial  on-line  retrieval  systems 
will  evolve  to  the  point  where  human  intermediaries 

] 

between  the  system  and  the  requester  become  unnecessary. 

‘i 

'i 

ORGANIZATIONAL 

STRUCTURES  AND  AFFILIATIONS 

n 

■1 

Question: 

Can  DDC  minimize  overlap  and  duplication  between  its 

''i 

•'i 

data  base  and  others? 

■s 

Event : 

Duplication  among  major  bibliographic  data  bases  will 
be  virtually  eliminated  through  interorganizational 

i 

agreements . 

Question ; 

Is  the  distributed  input  processing  concept  preferrable 
to  central  input  and  processing  at  DDC? 

i 

i 

1 

i 

Event : 

Input  of  information  to  large  IS&R  systems  (e.g.,  DDC, 
NTIS,  NASA,  etc.)  will  be  decentralized,  with  abstract- 

j 

ing,  indexing,  and  data  conversion  provided  at  the 
local  source  level. 
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Question: 

Will  it  be  possible  to  merge  DDC  and  other  relevant 
data  bases? 

Event: 

It  will  be  possible  for  a user  organization  to  readily 
merge  available  scientific  and  technical  bibliographic 
data  bases  into  a single  file. 

Question; 

Should  DDC  adopt  a more  centralized  approach? 

Event : 

Through  ready  access  to  a central  information  storage 
and  dissemination  facilities,  users  can  bypass  local 
information  or  library  facilities  and  these  can  be 
eliminated . 

Question; 

What  should  be  the  relationship  between  DDC  and  its 
peers  ? 

Event : 

Machine-readable  R&D  data  bases  will  be  electronically 
linked  so  that  a user  of  any  one  of  these  data  bases 
can,  with  proper  authorization,  directly  access  any 
other  data  base  through  an  on-line  terminal. 

Question: 

Is  a universally-adopted  Indexing  vocabulary  feasible? 

Event ; 

A single  standard,  interdisciplinary  subject  Indexing 
vocabulary  adopted  for  use  by  all  the  major  science 
Information  services. 

Qupjtion: 

Is  a common,  standardized  citation  format  feasible  for 
all  technical  literature,  thus  allowing  free  exchange 
of  document  surrogates  among  information-handling 
agencies? 

Event : 

Common,  standardized  citation  formats  for  all  technical 
report  literature  will  be  adopted  by  all  scientific  and 
technical  information  services. 

Question: 

Is  a common,  standardized  abstract  format  feasible  for 
all  technical  literature  thus  allowing  free  exchange 
of  document  surrogates  among  information  handling 
agencies'* 

Event : 

Common,  standardized  abstract  formats  for  all  technical 
report  literature  will  be  adopted  by  all  scientific  and 
technical  information  services. 

Question: 

Will  DDC  have  to  adopt  a standardized  protocol  for  DROLS? 

Event : 

Standardized  user  protocols  for  on-line  interactive 
retrieval  systems  will  be  adopted  by  all  technical 
information  services. 

I, 


Question:  Will  Federal  STINFO  services  be  consolidated  under  one 

or  more  umbrella  organizations,  causing  DDC  to  be 
merged  with  others? 

Event:  Virtually  all  Federal  technical  information  services 

will  be  merged  into  a central  organization. 


Question:  What  is  the  trade-off  between  DDC  performing  information 

processing  with  government  personnel  and  delegating 
these  activities  to  contractor  staff? 

Event:  Federal  agencies  will  employ  contractor  staff  to  perform 

virtually  all  of  their  information  processing  activities. 

III.  ECONOMICS  AND  MARKETING 

Question:  At  what  cost  will  DDC  be  able  to  supply  each  potential 

user  with  an  economical  interactive  terminal? 

Event:  Each  R&D  professional  will  be  able  to  purchase  an 

interactive  computer  terminal  for  less  than  $500, 


Question:  To  what  extent  will  DDC  need  to  become  self  supporting? 

Event:  Federal  technical  information  processing  and  dissemina- 

tion activities  will  become  virtually  self-supporting. 

IV.  SCOPE  OF  SERVICES  ■ 


Question: 

Can  DDC  and/or  its  users  electronically  tap  into  other 
relevant  data  bases? 

Event : 

Using  a single  terminal,  each  R&D  professional  will  be 
able  to  query  any  bibliographic  or  numeric  data  base 
of  his  choice. 

Question: 

Should  DDC  continue  to  publish  Its  abstract  Journal 
(TAB)  in  paper  form? 

Event : 

In  an  R&D  environment,  interactive  on-line  access  to 
bibliographic  data  bases  will  virtually  (i.e.,  907.+) 
replace  the  traditional  abstracting  and  indexing 
Journal  in  paper  form  as  literature  searching  tools. 

Question: 

Will  cheap  and  rapid  document  dissemination  techniques 
preclude  the  need  for  dissemination  of  abstracts? 

Event : 

Low  cost,  rapid  dissemination  of  full  text  of  documents 
will  preclude  the  need  for  abstracts  as  document  announce 
ment  and  retrieval  devices. 
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Question: 


Event : 


Question: 
Event : 


Question: 

Should  DDC  be  wholesaling  services  to  locaT  libraries 
retailing  services  to  individual  users,  or  both? 

Event: 

Two  tiers  of  information  providers  will  emerge  and  be 
clearly  definable:  those  large  Information  services 

which  wholesale  their  products  to  local  libraries  and 
service  centers;  and  local  activities  which  "retail" 
their  products  directly  to  end  users. 

Question: 

Is  the  lAC  concept  viable? 

Event : 

All  R&D  personnel  will  have  the  option  of  requesting 
detailed  analysis  and  synthesis  of  the  literature  of 
their  discipline  through  an  established  service,  such 
as  an  information  analysis  center.  > 

Question: 

Will  numeric  data  collection,  storage  and  retrieval 
become  a major  DDC  service? 

Event : 

In  the  R&D  environment,  the  collection,  storage,  and 
retrieval  of  numeric  data  will  at  least  equal,  if  not 
surpass,  in  volume  and  Importance,  the  processing  of 
bibliographic  information. 

Question: 

Should  DDC  provide  highly  select  data  bases  of  verified 
and  reproducible  research  results? 

Event : 

R&D  scientists  will  have  access  to  discipline  oriented 
data  bases  of  highly  select,  certified  and  validated 
numerical  data  as  opposed  to  bibliographic  references 
to  reported  results  and  data  bases  of  unverified  data. 

Should  DDC  direct  its  efforts  toward  subscription  and 
away  from  demand  services? 

Automatic  delivery  (as  opposed  to  delivery  upon  demand) 
of  information  products  such  as  documents  and  citations 
will  become  the  rule;  request  services  will  become  the 
exception. 


How  far  should  DDC  go  in  providing  tailored  services 
to  its  users? 


All  major  R&D  information  systems  will  permit  the  user 
to  specify  his  own  output  format,  with  virtually  no 
limitations  on  data  order  or  structure. 
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TABLE  E-1.  MOST  DESIRABLE  AND  MOST 
FEASIBLE  EVENTS 


EVENT 

TECHNOLOGY. 

• M6st  technical  information  retrieval  will  be  accomplished  by 
dial-up  communications  lines 

• Facsimile  transmission  will  be  competitive  with  postal  service 
in  cost 

• Paper  will  be  replaced  as  primary  numeric  storage  medium  by 
digital  media 

• OCR  will  be  able  to  convert  any  document  to  machine-readable 
form 

• Word  processing  equipment  making  available  machine-readable 
full  text 

ORGANIZATIONAL  AFFILIATIONS 

• Standardised  citation  formats 

• Standardised  abstract  formats 

ECONOMICS 

• Facsimile  transmlssior  competitive  with  postal  service  in 

cost 


SERVICES 


• Many  data  bases  accessible  through  a single  terminal 


TABLE  E.2.  MOST  DESIRABLE  AND  MODERATELY 
FEASIBLE  EVENTS 


EVENT 


A.  TECHNOLOGY 

• Machine  readable  storage  media  competitive  with 
paper 

• Flies  electronically  transferred  between  different  locations 
at  low  cost 

• Commercial  software  packages  replacing  most  original 
software  development 

e Most  packaged  software  machine  Independent 

B.  ORGANIZATIONAL  STRUCTURES  AND  AFFILITATIQNS 

e Standardised  user  protocols  for  on-line  retrieval  systems 

C.  SERVICES 


• Major  IS&R  systems  allowing  choice  of  output 

• Researchers  have  access  to  data  bases  of  ".actual" 
verified  numeric  data 


TABLE  E.3,  MOST  FEASIBLE  AND  MODERATELY 
DESIRABLE  EVENTS 


EVENT 

TECHNOLOGY 

• Machine-readable  storage  competitive  with  microform 

• Peripherals  with  mini's  will  take  over  many  automated 
functions 

• Interactive  computer  terminals  available  for  less  than 
$500 

• High  quality,  low  cost  microfilm  reader-printer  available 

• Paper  replaced  as  document  storage  medium  by  microforms 

• Automatic  monitoring  built  into  retrieval  systems 

• Paper  replaced  as  numeric  dissemination  medium  by  full-text 
digital  media 

ORGANIZATIONAL  AFFILIATIONS 

• Two  levels  of  information  providers:  "wholesalers"  and 

"retailers" 

ECONCMICS 

• Interactive  computer  terminals  available  for  less  than  $500 

• High  quality,  low  cost  microfilm  reader-printer  available 

SERVICES 

m 


Interactive  access  to  citation  data  bases  replacing  abstracting 
and  indexing  tools 


TABLE  B-4.  MOST  FEASIBLE  AND  LEAST  DESIRABLE  EVENTS 


EVENT 

TECHNOLOGY 


• Paper  virtually  replaced  as  a dissemination  medium  by 
microform 


TABLE  E >5.  MODERATELY  DESIRABLE.  MODERATELY 
FEASIBLE  EVENTS 


EVENT 

TECHNOLOGY 

• Associative  memories  commonly  used  for  machine-aided  fact 
retrieval 

• ’’Personal"  interactive  terminals  very  cotomon 

• Paper  replaced  as  document  storage  medium  by  full  text  digital 
media 

• Acceptable  machine-generated  index  data 

• Tutorial  features  of  on-line  systems  making  intermediaries 
unnecessary 

ORGANIZATIONAL  AFFILIATIONS 

• Unnecessary  data  base  duplication  eliminated 

SERVICES 


a "Personal"  interactive  terminals  very  common 

• Tutorial  features  of  on-line  systems  making  intermediaries 
unnecessary 

a Interactive  access  to  full  text  data  bases  replacing  abstract- 
ing and  indexing  as  searching  tools 


TABLE  E“6.  moderately  DESIRABLE  AND 
LEAST  FEASIBLE  EVENTS 


EVENT 


TECHNOLOGY 

• Associative  memories  will  be  consonly  used  In  machlne»alded 
retrieval 


ORGANIZAHONAL  AFFILUTIONS 


• Standardization  allowing  user  organizations  to  merge  data 
bases  onto  a single  file 


SERVICES 

• Information  synthesis  and  analysis  available  to  all  researchers 


TABLE  E-7.  MODERATELY  FEASIBLE  AND 
LEAST  DESIRABLE  EVENTS 


EVENT 

TECHNOLOGY 

• Paper  replaced  as  document  dissemination  medium  by  full-text 
microform  media 

s Paper  replaced  as  numeric  storage  medium  by  microforms 


ORGANIZATIONAL  AFFILIATIONS 

s Decentralized  Input  processing  for  large  IS&R  systems 


SERVICES 

• Processing  of  numeric  data  at  least  equalling  the  processing  of 
bibliographic  Information 


TABLE  E“8.  least  DESIRABLE  AND 
LEAST  FEASIBLE  EVENTS 


EVENT 


A.  TECHNOLOGY 

• Computers  designed  specifically  for  bibliographic  storage 
and  retrieval 

• Paper  replaced  as  document  dissemination  medium  by  full-text 
digital  media 


B.  ORGANIZATIONAL  AFFILIATIONS 


• One  Interdisciplinary  subject  vocabulary 

C.  ECONOMICS 

• Federal  technical  Information  services  self-supporting 

D.  SERVICES 

• Dissemination  of  full  text  of  documents  precluding  need  for 
abstracts  as  announcement  devices 

• Dissemination  of  full  text  of  documents  precluding  need 
for  abstracts  as  retrieval  devices 


